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Abstract 

This brief article reviews stochastic processes 
as relevant to dynamical models of wave- 
function collapse, and is supplemental mate- 
rial for the review article larXiv: 1204.43251 

The best known example of a stochastic 
process is Brownian motion : random 
motion of small particles suspended in a 
liquid, under the influence of a viscous 
drag, and a fluctuating force resulting from 
collisions with the molecules of this liquid. 
The quantitative explanations of Brownian 
motion by Einstein and Smoluchowski were 
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simplified by Langevin, through his use of 
what is now called the Langevin equation. 
This dynamical equation for the randomly 
evolving position of the suspended particle 
is equivalent to the Fokker-Planck equation 
for the time evolution of the probability 
distribution of the random variable. The 
Langevin equation can be put on a firm 
footing stochastic differential equation 
using Ito's differential calculus for stochastic 
variables. The brief review below intro- 
duces stochastic processes, and should be 
of some assistance in understanding the 
review arti cle on dynamical wave-function 



collapse (IBassi et all |2012| ) and should 



be read in conjunction with that review. 
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all points i,j satisfying i ^ j then 



i=l 



A. Some Basic Concepts from Proba- The triple {Q, P) is defined to be the prob- 
bility Theory ability space. 

Let Q denote a sample space, i.e. a set of 
all possible events in an experiment. Then ^' r^^iidom Variables 
one can define the following structures on Q 

Definition 3. A random variable is a func- 
Definition 1. A collection of subsets of VL tion X : n ^ R with the property that 
IS called a a- field if {uj ^ ^ : X{uj) < x) ^ 7 for each x G R, 

such functions are called T— measurable. 

1. (heJ^. 



2. ifAi,A2---eJ' then UZiAi € J^. 

3. ifAeT then A^ e T . 

The above properties also imply that 
closed countable intersections are also in- 
cluded in J^. 

Examples: 

a) J-" = {0, Q} is the smallest a— field. 
h) If A C n then J" = {0, A, A^, Q} is a 
(T-field. 

Definition 2. A probability measure P on 
(fi, J^) is a function P : J-" — t- [0, 1] satisfying: 

1. p{(j)) = 0,P(fi) = 1. 

2. if Ai, A2 . . . is a collection of disjoint 
members of T in that A^ n Aj = (p for 



1. Distribution of random variables 

• X is called a discrete random variable if 
it takes values in some countable sub- 
set {xi, X2, . . . ,} only of R. Then X 
has probability mass function / : R — )■ 
[0, 1] defined by f{X) = P{X = x). 

• X is called a continuous random vari- 
able if its distribution function F : 
R [0, 1] given by F{x) = P{X < x) 
can be expressed as 



Fix) 



f{u)du a; G R 



for some integrable function / : R — >^ 
[0, 00), where / is the probability den- 
sity function. 
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• Joint distribution Function : A ran- [to,to + T] can be known completely. 

dom variable X — {Xi,X2, . . -Xn) on obtain probability densities with 

(il, P) is a function Fx : R" [0, 11 , , t ■ u^ t t 

^ ' ' ^ ^ I- ' J lower number oi variables rrom those or 

given by Fx(x) — P(X < x) for x G j^jgj-^gj. number of variables by integrating as 

follows. For i < r 

2. Time Dependent Random Variables ^2, ■ ■ ■ , x^) 

f f 

Let ,^ = .^(t) be a time dependent random dx -^i dx (3) 
variable. Assume an ensemble of systems, 

such that each system leads to a number ^ Conditional Probability density is defined 
which depends on time. 

The outcome for one system cannot be 
precisely predicted, but ensemble averages P{xi\x2 ■ ■ -Xr) — ^r{xi...Xr) 

M^r-l(2^2, • • • Xr) 

exist and can be calculated. For fixed t — ti 

we define the probabihty density by where P{xi\x2 ...Xr) denotes the probability 

density of Xi given the 2:2, . . . , x^. 

W,{x,,t) = {5{x,-i{h))) (1) 

where the angular brackets denote the en- 
semble average. The probability to find the 3. Stationary Processes 
random variable ^(^i) in the interval xi < 

iiti)< xi + dxi is given by Wi{xi,t)dxi, . . . , K the probability densities do not change 
in interval Xn < ^{tn) < Xn + dxn is given by replacing U by + T (T arbitrary) the 
by Wn{xn,tn;...;xi,ti) dxndx^n-i) ■ ■ ■ dxi, wocess is called & stationary process. \n such 
■where ^ case Wi does not depend on t and W2 can 

depend on the time difference ^2 — ^i- 

^n{Xn-, tn', ■ ■ ■', Xi,ti) — 

The Wiener-Khinchin Theorem : Ac- 

(5(xi-e(tl))...5(x„-e(in))) (2) ^. ^ , ,^ 

cordmg to this theorem, the spectral density 
Given Wn for all n, for every t, in the inter- ^he Fourier Transform of the correlation 
val to<t,<to + T the time dependence of ^^^^^^^^ stationary processes, 
the process described by ^{t) in the interval Instead of the random variable ^{t) one 



may consider its Fourier Transform C. Stochastic Processes and their Clas- 

sification 

/oo 
-oo 

Stochastic processes are systems which 

For a stationary process is a func- , u t -i- n • ^ • u- i, 

^ V evolve probabilistically, i.e. systems m which 



tion only of the difference t — t' i.e. 
Introducing the new variables 
to^{t + 0/2 

we have 

/oo 
exp{-i{uj - uj')to)dto 
-oo 

expi-ticu' + uj)T/2mT)CmdT (4) 
which gives 



where 



/oo 
exp(ia;r)(e(T)r(0))d7 
-oo 



is the spectral density. 



a time-dependent random variable exists. 

The stochastic processes described by a 
random variable ^ can be classified as follows 

Purely Random Process: If Pn{n > 2) 
does not depend on the values Xi — ^{ti), {i < 
n) at ti < tn, then, 

P(^Xyi, tji\Xji—l, t^i—i, ■ ■ ■ , Xi, ti) P(^Xji, tji) 

thus 

Wn{Xn, tn,...; Xi, ti) = P{Xn, tn) . . . P{xi, ti) 

Hence, complete information of the process is 
contained in P{xi, ti) — Wi{xi, ti). A purely 
random process cannot describe physical sys- 
tems where the random variable is a contin- 
uous function of time. 

Markov Process: If the conditional 
probability density depends only on the value 

{(tn-i) = Xn-i at , but not on {(t„_2) = 
Xn-2 at tn-2 and so on, then such a process 
is known as a Markov Process. This is given 

by 

P{Xn, tn\Xn—l, ^n— Ij ■ ■ ■ j -^1) ^l) — 
P{Xn,tn\Xn—l,tn—l) (5) 



Then it follows that 



Prom the defintion of conditional probability 



Wn{Xn,tn; ■ ■ .■,Xi,ti) = 

Pi^ni ^n\Xn—li ^n—l)P{Xn—li ^n—l\Xn—2i ^n— 2) 

...P{x2M\xiM)Wi{x^M) (6) 
For n = 2 

Wi[xi,ti) 

For a Markov process the complete in- 
formation of the process is contained in 

W2{x2,t2]Xi,ti). 

General processes: There can be other 
processes such that the complete information 
is contained in W3, W4 etc. However this 
classification is not suitable to describe non- 
Markovian processes. For describing non- 
Markovian processes, more random variables 
(other than i{t) = • • • , U^)) can 

be considered. Then by proper choice of these 
additional variables, one can have a Markov 
process for r random variables. 

D. Markov Processes 

The Markov ssumption is formulated in 
terms of conditional probabilities as follows 

P(xi, ti\ X2, t2]... Ti; y2, T2; . . . ) 
= P(xi,ti;a;2,t2; ■ ■ ■ |z/i,Ti) (7) 



P(xi,ti;x2,t2|yi,Ti) = 

P{xi, ti\x2, t2] yi, Ti)P{x2, t2\yi, Ti) 

(8) 

Using Markov property one can write 

P{Xl, ti, X2, t2'i 2:3, ^3; . . . ; Xni tn) ~ 

P{X1, ti\x2, t2)P{x2, t2\x3, t3)P{x3, t^lx^, t^) 

. . . P(^Xn—l, tn—llXn, t^jPi^Xn, t^) (9) 

provided ti>t2>tz>t4^>... tn-i > tn- 

1. The Chapmann Kolmogorov Condition 

The following condition holds for all 
stochastic processes : 

P{Xi,ti) = J dX2P{Xi,ti;X2,t2) 
= J dX2P{x^,h\x2,t2)P{x2,t2) (10) 

Now 

P{xi,ti\x3,t3) ^ J dX2P{xi,ti;X2,t2\x3,ts) 

J dX2P{xi,ti\x2,t2;X3,t3) 
P{x2,t2\x3,t3) 

Introducing the Markov assumption, if ti > 
h > ^3, then we can drop dependence on 



X3,h. Thus, 



the following form: 



P(Xi,ti|x3,t3) = 

J dX2P{Xi,ti\x2,t2)P{x2,t2\x3,t3) (11) 

This is the Chapmann Kolmogorov Equation. 
The differential form of this equation plays an 
important role in the description of stochastic 
processes that follows. 



W{x, t + r)- W{x, t) = ^}^^r + 0{t^) 



dt 



n=l 



d 



5^ i dx 



(13) 



Mn can be ex panded into T aylor series with 
respect to r ( Riske J . 1996 ) {n > 1) 



Mn{x,t,T)/n\ = D^''\x,t)T + Oir^) 



2. The Fokker-Planck equation 

From the definition of transition probabil- 
ity one can write 

W{x,t + T) = j P{x,t + T\x',t)W{x\t)dx' 

(12) 

This connects W{x,t + r) with W{x' ,t). To 
obtain a differential equation for the above, 
the following procedure can be carried out. 
Assume that all moments M„(a;,t, r),n > 1 
are known 

M„(x', t, r) = < [iit + r) - i{t)f > y)=x' 
(x — x)^P{x, t + r|x', t)dx 



Introducing A = x — x' in equation fll2p . the 
integrand can be expanded in a Taylor series, 
which after integration over 6 can be put in 



Considering only linear terms in r, Eqn. ( !T3|) 
can be written as 



dW{x,t) 
di 



n=l ^ ' 



LKMW{x,t) 



n=l ^ ^ 

The above is the Kramers-Moyal Expansion. 
Pawula Theorem states that for a positive 
transition probability P the Kramers-Moyal 
expansion stops after the second term; if not 
then it must contain an infinite number of 
terms. 

If the K-M expansion stops after the sec- 
ond term, then it is called the Fokker -Planck 
equation, given by 



dW{x,t) 
dt 



-^D^'\x,t) + ^^D(^\x,t) 
ox ox^ 

(15) 

D^^^ is called the drift coefficient, and D^'^^ is 
called the diffusion coefficient. The transition 
probability P{x,t\x' ,t') is the distribution 



W{x,t) for the initial condition W{x,t') = The Fokker-Planck equation can be taken 

6{x — x'). Therefore the transition probabil- as a starting point for introducing the con- 

ity must also satistfy ( IT^ . Hence, cept of a stochastic differential equation. If 

^ ^ the random variable ^(t) satisfies the initial 

dP{x,t\x ,t) ^ Lkm{x, t)P{x, t\x', t') (16) condition 

where the initial condition is given by p^/^^j-^^^ _ _ ^j^g-^ 
P(x, t\x\ t) = 6{x — x'). 



The Fokker-Planck equation can also be 
written as 



that is, it is sharply peaked at the value y, it 
can be shown by solving the Fokker-Planck 



dW dS^ _ equation that a short time At later, the solu- 

Qt 'dx ~ 

tion is still sharply peaked, and is a Gaussian 
^^^^^ with mean y + D^^^At and variance D^'^K The 

Q picture is that of a system moving with a sys- 

S(x,t) = [D^^Ux,t)--^D^^\x,t)]W(x,t). . , , . 

ox tematic drift velocity ' , and on this mo- 

tion is superimposed a Gaussian fluctuation 
with variance D^'^\ Thus, 



Here S can be interpreted as a proba- 
bility current. We will discuss the one 



variable Fokker-Planck equation with time- , ^ , , , / x a i /9 

^ y{t + At) = y{t) + D^^>At + 7]{t)Af'^ (20) 

independent drift and diffusion coefficients 

Si^^^ where (r/) = and {r]^) = D^^\ This picture 

fiu/frr +\ ft rP' gives sample paths which are always contin- 

dt dx dx"^ uous but nowhere differentiable. As we will 

see shortly, this heuristic picture can be made 

For stationary processes the probability ^^^^ ^^^^ ^^^^-^^ 1^^^^ ^^^^^p^ 

current S = constant. Methods of solution stochastic differential equation, 
of such a F-P equation for stationa ry pro- 



cesses are discussed in (IRisken 



19961). Non- 



3. Wiener Process 
stationary solutions of the F-P equation are 

in general difficult to obtain. A general ex- A process which is described by Eqn. ( |T8 



pression for non- stationary solution can be with D^^^ = and D'^'^\x) = D = constant, 
found only for special drift and diffusion co- is called a Wiener process. Then the equation 
efficients. for transition probability P = P{x,t\x' ,t') is 



the diffusion equation, given by 



dP _ ^d'^P 
dt dx^ 



(21) 



The Fokker-Planck equation then can be 
written as 



dP d d'^ 



with the initial condition P{x,t'\x' ,t') = 
6{x — x'). Then the solution for t > t' is with initial condition P{x,t'\x' ,t') = 6{x — 
given by the gaussian distribution x'). The above equation can be solved by 

taking a Fourier transform w.r.t. x i.e. 



P{x,t\x\t' 
1 



exp 



^ATxD{t - t') V ^D{t - t') 



l\2 



{x — x') 



(22) P{x,t\x\t') = (27r)-^ / e'^''P{k,t\x',t')dk 



Thus the general solution for probaility den- Thus it results in the following equation 
sity with initial distribution W{x', t') is given 
by 



W{x,t)= P{x,t\x',t')W{x',t')dx' 



An initially sharp distribution spreads in 
time. The one-variable Wiener process is of- 
ten simply called Brownian motion, since it 
obeys the same differential equation of mo- 
tion as Brownian motion. 



with initial condition P{k,t'\x't') = e*^^' for 
t > t'. Then one gets 

P{k,t\x',t') = 

exp[-ikx'e'^'^'-''^ - Dk\l - e-2^(*-*'))/(27)] 

(24) 

By applying the inverse Fourier transform 
one finally obtains the solution of the Fokker 
Planck equation describing the Ornstein Uh- 
lenbeck process 



4-. Ornstein- Uhlenheck Process 

This process is described by Eqn. f|T8|) 
when the drift coefficient is linear and dif- 
fusion coefficient is constant, i.e. 

D^^\x) = --fx; D^'^\x) = D = const 



P(x,t\x't 



7 



exp 



27rD(l - e-27(*-*')) 
7(x - e-^(*-*')x')^ 



X 



2D{1 - e-27(t-t')) 



(25) 



In the limit 7 — )■ we get the Gaussian dis- 
tribution for a Wiener Process. 



Eqn. (l25|l is valid for positive and negative 
values of 7. For positive 7 and large time 
difference 7(t — t') ^ 1 the equation passes 
over to the stationary distribution given by 

Wst = \l-^exp \--^] (26) 
V 27rD ^ [ 2D\ ^ ^ 

For 7 < no stationary solution exists. 



is observable and hence the velocity of the 
small paricle cannot be described by Eqn. 
(|27l) . Thus this equation has to be modified 
as follows: 

v + ^v = r{t) (28) 

where r(t) = Ff{t)/m is the stochastic term, 
Ff{t) is the fluctuating force acting on the 
particle. This is the Langevin equation. 



E. Langevin Equation 

We introduce stochastic integration via 
the Langevin equation. In the presence of 
a viscous drag linearly proportional to veloc- 
ity, the equation of motion for a particle of 
mass 'm' is given by 

mi) + av = (27) 

or 

V + 'jv = 

where 'j = a/m = 1/t, t being the relaxation 
time. The solution of the above equation is 
given by 

v{t) = v{0)e~'/^ = v{0)e-^' 

If the mass of the particle is small, so that 
the velocity due to thermal fluctuations is not 
negligible, then 

vth = \fW) = \/kT/m 



1. Brownian Motion 

The Langevin equation for Brownian mo- 
tion is given by Eqn. fl28|l where F describes 
the Langevin force with 

(F(t)) = o, {mm) = qs{t-t') 

such that all the higher moments are given in 
terms of the two point correlation function. 
In other words, F is gaussian distributed with 
zero mean. The spectral density of noise, de- 
scribed below, gives color of the noise. The 
delta correlated noise is referred to as white 
noise. This model of noise in the Langevin 
equation fully describes ordinary Brownian 
Motion of a particle. 

The spectral density for delta correlated 
noise is given by 

/oo 
e-^^"5(r)rfr = 2q 
-00 

Since it is independent of u it is called white 



noise. In general the spectral density depends for a Brownian particle. 

on ti;; in such a case, the noise is called col- According to the law of equipartition 

ored noise. 

{E) = \kT 

2. Solution of the Langevin equation ^^^^ comparing with the earlier expression we 

get 

The formal solution of the Langevin equa- 

q — 2^kT/m 

tion is given by 

y^-f.-^ ^ VqC"'^* + / e''^^^^^'^T{t')dt' (29) ^' Overdamped Langevin equation 

The overdamped Langevin Equation looks 







By using the white noise model one can ob- 

like 

tain the correlation function of velocity i 

v{t) = -m 

{v{ti)v{t 2)) — VqC + where the acceleration term is dropped be- 

lie ti h)q§{f'^ — t'2)dt'idt'2 cause of the prominence of damping. In the 

JO Jo 

(30) large time limit, the two point correlation for 
velocity is given by 

which after solving for the double integral 

gives (^(^1)^(^2)) ~ ^{V{ti)V{t2)) = ^5{h - t2) 

{v{h)v{h)) = vle-'^^'^+'^^ + 

4.- Non-linear Langevin Equation 

_^(e"7|ti-t2| _ g-7(ti+t2)^_ ^3]^^ 

A nonlinear Langevin equation has the fol- 
For large ti and ^2, i-e 7^1, 7^2 ^ 1 the corre- j^^j^g fQ^.^^ 

lation is independent of Vq and is a function 

of the time difference. ^ ^ /^(^^ ^) + g^^^ ^)r(t) (32) 

{v{ti)v{t2)) = — e '''' ^ ^' Here T{t) is assumed to be Gaussian random 

variable with zero mean and 5 correlation 

Now in the stationary state r , . 

function. 

{E) = -m{v{tf) = -m^ ^p^^^^ ^ Q. (r(i)r(i')) = m - t') 

10 



Integrating Eqn. (132|) Assuming ^(0) = x 

^= f h{^,t)dt+ f g{^,t)Tit)dt (33) {^{t)) = {xexp[a f r{t')dt']) 

Jo Jo ^ 

= x[l + a / {T{ti))dti + 

Here could be a constant or can depend on Jq 

^. Constant g gives additive noise, while if it 1^2 f f (^Y{ti)r(t2))dtidt2 + . . . ] 

depends on ^ it is referred to as multiplicative ^^^-^ 
noise. For ^ dependent in the above equa- 
tion, since r{t) has no correlation time, it is 
not clear which value of ^ one has to use in g 

while evaluating the integral. Physicists use Since T is delta correlated Gaussian white 

an approximation of the 5 function to ensure ^oise, all the higher correlations can be ex- 

that one gets appropriate results. But from a Passed in terms of two point correlations, 

purely mathematical point of view one can- therefore the above equation can be written 

not answer this question, unless some addi- following form 



tional specification is given. Thus, this gives (^2n) 
rise to the requirement of using the stochastic 2"n 

integrals, namely the Ito and Stratonovich in- = gxp 
tegrals for solving such equations. In the fol- 
lowing section, we give a brief introduction 



t rt 



JO 



(f){ti — t2)dtidt2 



]-a^ [ [ {r{ti)r{h))dhdt2 

Jo Jo 



(35) 



(36) 



to these Stochastic Integrals. Prior to this For delta correlated Langevin force the dou- 
we state an example of a particular form of ble integral gives 
noise and solve the nonlinear Langevin equa- 
tion for this particular case. 



Example For g = where a is a constant 

i = aer(t) and 



(^(t)) = xexp(a^t) 



The formal solution of the above equation is {^{t)) = a (^(t)) with (^(0)) = x 



given by 



^{t) = X exp 



a [ r{t')dt' 
. Jo 



j^{m)\t=o = a^x 
is called spurious or noise induced drift. 
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F. Stochastic integration, Ito calculus can be interpreted consistently. We make the 
and stochastic differential equations replacement 



dW{t) = W{t + dt) - W{t) = C{t)dt (40) 
Consider a Langevin equation of the form ^^^t the second integral can be written as 
a{x,t)+b{x,t)C{t) (37) / b[x{s),s]dW{s) (41) 

«/ 



dx 
'dt 



for a time-dependent variable x, where a{x, t) ^^i^h is a stochastic Riemann-Stieltjes inte- 
and b{x,t) are known functions, and C{t) is S^^^' ^^^^^ ^® 

the rapidly fluctuating random term which ^. , . , ., r 

Given that G{t) is an arbitrary function 

induces stochasticity in the evolution. We ^ , . , tia/j.\ ■ ^ t j.- j.i 

of time and W[t) is a stochastic process, the 

want to examine the mathematical status of , , , . . , , rt jtia/^/\ ■ j n j 

stochastic integral G(r) dW{t ) is denned 

this equation as a differential equation. Since , ,. .,. ,i . , ^ .\ ■ . ^ 

by dividing the interval (0, ij into n sub- 

we expect it to be integrable, the integral . , , /, , s i , i , 

° ° intervals (ij_i, ij) such that 



u{t)^ fdt'Cit') (38) 

^0 



to<ti<t2<---<t (42) 



should exist. If we demand that m is a contin- 
uous function of t, then it is a Markov pro- 



and defining intermediate points Ti such that 

ti-i < Ti < ti. The stochastic integral is 

cess whose evolution can be described by a , r. , t <■ i 

defined as a limit of partial sums 

Fokker-Planck equation, which can be shown 

n 

to have zero drift, and diffusion unity. Hence, 5„ = ^ G{ri)[W{t,) - W{t,.^)]. (43) 
u{t) is a Wiener process, denoted say by i=i 

W(t); but we know that W(t) is not differ- „, , • ,i , ^/,x i • r ^- r 

^ ' ^ ' ihc chaUenge is that, G(tj being function of 

entiablc. This would imply that in a mathc 



matical sense the Langevin equation does not 
exist! However, the corresponding integral 
equation 



a random variable, the limit of Sn depends 
on the partcular choice of intermediate point 
Tj! Different choices of the intermediate point 
give different results for the integral. 



{t)—x{0) — / a[x{s), s\ds+ / b[x{s), s]({s)ds Denoting A = max{ti — ij-i), the ltd 
Jo Jo 

(39) stochastic integral is defined by taking Ti — 
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ti-i and taking the limit of the sum : some stochastic differential equation, a for- 

mula can be given relating the two differen- 



G{t ) dW{t ) ^.^^ equations. 

n 

^mJ^GiU-iWiU) - W{U^^)]. (44) 



A->0 

i=l 



1. Rules of ltd calculus 



As an example, it can be shown that 

^ Mean square limit or the limit in the mean 

/ W{t') dW{t') = is defined as follows: Let Xn(oj) be a sequence 
Jo 

1 r-r-rr, ^') ^ -r r , x9 / xi /.^x of raudom varlablcs X„ on the probability 
[W{tf-W{tof-{t-to)]. (45) 

space r2, where co arc the elements of the 

Note that the result for the integration is no space which have probability density p{u). 

longer the same as the ordinary Riemann- Thus one can say that X„ converges to X 

Stieltjes integral, where the term {t - to) in the mean square if 

would be absent; the reason being that the r 

merenceW{t + At)-W{t) is almost always il^ J ^'-PH[^n(a;) - X(a;)]^ ^ 

of the order which implies that, unlike in lim((^n - X) ) = (47) 

ordinary integration, terms of second order in 

This is written as 

AW{t) do not vanish on taking the hmit. 

An alternative definition of the stochastic _ X = X 

n— >oo 

integral is the Stratanovich integral, denoted 

by S, and is such that the anomalous term Rules 

above, (t — to), does not occur. This happens 

if the intermediate point Tj is taken as the ^' '^^(^) ~ 

mid-point = {ti + ti+i))/2, and it can then ^ dW^+^{t) = 

be shown that 



The above formulae mean the following 



s I w{t')dw{t') = hw{tf-w{ton 

(46) / [dWit't^'^Git') ^ 

J to 

For arbitrary functions G{t) there is no mg — limn — >■ oo Gj^i/XWf^^ 

connection between the Ito integral and the ^ ' 

Stratanovich integral. However, in cases — / dt'G{t') ior N — 

J to 

where we can specify that G{t) is related to = for A?" > (48) 
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for an arbitrary non-anticipating function G. 
Proof: 

For N — consider the following sum 
7= \un{[J2GUAW^-AU)n (49) 

i 

= lim ( V(G,_i)'(AW,2 - + 

i 

^ 2G,_iG,_i(AW^^ - Ai,)(AW,^ - At,)) 

(50) 



lier 



Using the following results mentioned ear- 

(AW^) = AU 
{AW^ - Ati)^ >= 2At1 

one gets 

7 = 2 lim [Y,At]{{G,.,)')] 

i 

This can be written as 

ms - lim (V d-iAW^ - V G^-i Ai^) = 



smce 



ms - lim V Atj = / c^t'G(t') 



we get 



to 



[dW{t')]''G{t') = f dt'G{t') 

J to 



from this we see that dW{t')'^ — dt'. Similarly 
one can show that dW{t)^+^ = 0{N >0). 



Another important result that can be 
proved by the above method is 



/' 

J to 

ms 



G{t')dt'dW{t') = 

- lim y"Gi_iAWiAti = (51) 

n. — yon ' ^ 



Rule for integration of polynomials : 



W{tT dW{t') 



to 

1 



n + 1 



[W{t) 



(n+l) 



W{to) 



-\ JtlW{t)^n-l)dt (52) 



General rule for differentiation ; 
df[W{t),t]^(% + lS,]dt + 



dt 2dW^ 



df_ 
dW 



dW{t). 



(53) 



2. Stochastic differential equations 



The Ito integral is mathematically the 
most satisfactory, but not always the most 
natural physical choice. The Stratanovich 
integral is the natural choice for an inter- 
pretation where (^{t) is a colored (not white) 
noise. Also, unlike in the Ito interpretation, 
the Stratanovich interpretation enables the 
use of ordinary calculus. From the mathe- 
matical point of view, it is more convenient 
to define the Ito SDE, develop its equvalence 
with the Stratanovich SDE, and use either 
form depending on circumstances. 

A stochastic quantity x{t) obeys an Ito dif- 
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ferential equation If we formally treat this as an equation for 

Inip then upon comparison we see that Inip 
dx{t) = a[x{t),t]dt + h[x{t),t]dW{t) (54) is a;, and 

if for all t and to a{x{t),t\ = —jH — —{q — {(l)tY 

h = y/\{q-{q)\ (58) 

x{t) = x{to) + / dt'a[x{t'),t'] + 

J to 

* The real part of the drift coefficient a is re- 

dW{t')b[xit'),t']. (55) 
to lated to the diffusion coefficient 6^ by 

If f[x{t)] is an arbitrary function of x{t) then 

Ito's formula gives the differential equation ^'^ ^ ^^^^ 

satisfied by f : 

This non-trivial relation between diffusion 
df[x{t)] = ^^^^^ what gives the equation its norm- 

r j^T^/r , ^rr j.i2 j:iu /^\t\ tj. preserving martingale property which even- 
a[x{t),t]f'[x{t)] + -b[x{t),tYr[x{t)]\dt 

^ tually leads to the Born rule. Why the drift 

^h\x(t),t\f\x{t)\dW{t). (56) 

and diffusion must be related this way is at 
Thus change of variables is not given by ordi- Present not understood in Trace Dynamics 
nary calculus unless j\x{t)\ is finear in x{t). ^nd there probably is some deep underlying 

reason for this relation. 

Given the time development of an arbi- 

Stratonovich's stochastic differential equa- 

trary /[a;(t)], the conditional probability den- 

tion : Given the Ito differential equation 

sity p(a;, t|xo, to) for 3;(t) can be shown to sat- 

( 15^ its solution xit) can also be expressed 

isfy a Fokker-Planck equation with drift coef- 

in terms of a Stratonovich integral 

ficient a(x, t) and diffusion coefficient 6(x, t)^. 

The stochastic differential equation stud- x(t) = Xq + dt a[x{t),t] + 

i ed in detail i n the QMUPL model /"* , r, , ,. , s 
^ S dW{t')(3[{x{t'),t'] (60) 

Jtn 



( Bassi et al. 



dipt 



2012f ) Jto 

A where 
Hdt + ^{q-{q)t)dWt 

n 

1, 



-^{q-{q),Ydt 



(^57) a{x, t) = a{x, t)--b{x, t)d^b{x, t); (3{x, t) = b{x 

(61) 

is an Ito differential equation of the type In other words, the Ito SDE (|5^ is the same 
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as the Stratonovich SDE 

dx = [a{x, t) - ^b{x, t)d:cb{x, t)]dt + bdW{t) 

(62) 

or conversely, the Stratonovich SDE 

dx = adt + l3dW{t) (63) 

is the same as the Ito SDE 

dx = [a{x, t) + ^P{x, t)d^p{x, t)]dt + pdW{t) 

(64) 

It can be shown that in a Stratonovich SDE 
the rule for change of variable is the same as 
in ordinary calculus. 

G. Martingales 

Martingales play a role in stochastic pro- 
cesses roughly similar to that played by con- 
served quantities in dynamical systems. Un- 
like a conserved quantity in dynamics, which 
remains constant in time, a martingale's 
value can change ; however, its expectation 
remains constant in time. 

A martingale is defined as follows: 
A discrete time martingale is a discrete 
time stochastic process, Xi,X — 2, . . . , that 
satisfies for any time n, 

E{\Xr,\) < OO 
-E'(-'^n+l|-'^l, ■ ■ ■ ) ^n) — 
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where E{X) denotes the expectation of X. 

Martingale Sequence with Re- 
spect to Another Sequence A sequence 
Yi,l2j--- is said to be a martingale w.r.t. 
another sequence Xi, X2, X3 . . . if for all n 

E(|F„|) <oo 

£;(y„+i|Xi,...,x„) = o 

In other words, a martingale is a model of a 
fair game, where no knowledge of past events 
can help to predict future winnings. It is a 
sequence of random variables for which at a 
particular time in a realized sequence, the ex- 
pectation of the next value in the sequence 
is equal to the present observed value even 
given knowledge of all prior observed value 
at current time. 
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